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Abstract. We enumerate bijectively the family of involutive Baxter permu- 
tations according to various parameters; in particular we obtain an elementary 
proof that the number of involutive Baxter permutations of size In with no 
fixed points is r^jjf^fjft C") i a formula originally discovered by M. Bousquet- 
Melou using generating functions. The same coefficient also enumerates planar 
maps with n edges, endowed with an acyclic orientation having a unique source, 
and such that the source and sinks are all incident to the outer face. 



1. Introduction 

Baxter permutations, named after Glen Baxter [5] who introduced them in 
an analysis context, are pattern- avoiding permutations (precisely the forbidden 
patterns are 2 — 41 — 3 and 3 — 14 — 2) with many nice combinatorial proper- 
ties [T71 [7J [TCI E] . Their counting coefficients appear recurrently in combinatorics; 
the so-called Baxter number (the number of Baxter permutations of size n) 
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also counts plane bipolar orientations with n edges [3] , certain rectangulations with 
n points on the diagonal |12[ [T] , certain Young tableaux with parity constraints [B] , 
and so on. Subfamilies of Baxter permutations have also been considered: alternat- 
ing and doubly alternating Baxter permutations have been enumerated in [8l 1101 H~4] . 
and Baxter permutations of size n avoiding the pattern 2 — 4—1 — 3 have been 
shown to be in bijection with rooted non-separable maps with n + 1 edges E] 
(therefore there are (2n+3)!(n+2)! sucn permutations of size n). A permutation in 
& n is classically drawn as an n x n grid G of unit squares, with exactly one boxed 
square in each row and in each column. With this representation in mind, it is 
known (see e.g. [3]) that the set of Baxter permutations of size n is globally invari- 
ant by any of the 8 transformations of the dihedral group acting on the grid G. So 
it is a natural problem to try to count how many Baxter permutations are fixed by 
a given transformation of the dihedral group. In a previous paper [12] the case of 
the half-turn rotation was solved (whereas the case of rotations of order 4 is open) ; 
the idea is that a Baxter permutation can be encoded by a nonintersecting triple 
of paths, in a way that commutes with the half-turn transformation. 

In this note we focus on the mirror reflection according to a diagonal, that is, we 
count involutive Baxter permutations. A difficulty is that the encoding of Baxter 
permutations by triples of paths does not commute in any sense with the diago- 
nal mirror transformation (there is no nice transfer of mirror symmetry from the 
Baxter permutation to the associated triple of paths). An important ingredient 
here is the recent article [4], in which the authors establish a direct bijective corre- 
spondence between Baxter permutations and so-called plane bipolar orientations, 
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which are acyclic orientations on embedded planar graphs (i.e., planar maps) with 
a unique source and a unique sink both lying in the outer face. Thanks to this 
correspondence, the successive combinatorial manipulations to encode involutive 
Baxter permutations can be carried out on (oriented) planar maps, which we find 
convenient to handle due to their more geometric flavor. As a consequence of our 
bijective encoding we obtain: 

• a closed- form multivariate formula (in Theorem [5]) for the number of invo- 
lutive Baxter permutations according to the numbers of elements, descents 
(which are of two types, either crossing or not crossing the diagonal {x = y} 
in the diagrammatic representation), and fixed points. 

• a closed-form univariate formula (in Theorem [5]) for the number b n of in- 
volutive fixed-point free Baxter permutations of 2n elements: 

3 • 2™- 1 f2n\ 
n ~ (n + l)(n + 2) [n ) ' 

Note that b n has surprisingly a simpler (summation-free) expression than the Bax- 
ter number B n . The univariate formula for b n (already announced in U) and a 
multivariate formula restricted to fixed-point free Baxter permutations have been 
discovered by M. Bousquet-Melou [5] using generating functions and the so-called 
"obstinate" kernel method. As follows from the correspondence with plane orienta- 
tions (to be described in Section [2]) the number b n also counts acyclic orientations 
on planar maps with n edges, a unique source, and all extremal vertices (source 
and sinks) lying in the outer face. 

Outline. The main steps of our method are the following: (i) by a quotient-argument 
already outlined in [3] , interpret the plane bipolar orientations corresponding to in- 
volutive Baxter permutations as certain plane bipolar orientations with decorations 
at the corners and edges incident to the sink, (ii) adapt the known bijective en- 
coding of plane bipolar orientations by non-intersecting triples of paths to take 
account of the decorations, (iii) count the obtained non-intersecting triples of paths 
using the Lindstrom-Gessel-Vicnnot lemma (for the multivariate formula) or similar 
principles with small adjustments (for the univariate formula). 

2. Involutive Baxter permutations as decorated plane bipolar 

orientations 

Let B be the class of Baxter permutations and O the class of plane bipolar 
orientations. As shown in [3] (see FigureQ]for an example), one can construct from 
the diagrammatic representation of n £ B an embedded plane bipolar orientation 
4>{~n) where black points of degree 2 correspond to edges (one such vertex on each 
edge) and white points correspond to vertices. The induced mapping <f> from B 
to O (where <&(7r) is the plane bipolar orientation induced by 4>(tt) after erasing 
the black vertices) is a bijection that satisfies several parameter correspondences 
(elements are mapped to edges, descents are mapped to non-pole vertices,...) and 
preserves many symmetries; in particular if ir is involutive (i.e., ir^ 1 = n) then 4>(tt) 
is fixed by the reflection according to the line {x = y}, see Figure Ufa). 

A planar map is a connected graph planarly embedded in the plane (considered 
up to continuous deformation). Define a monosource orientation as an acyclic 
orientation O of a planar map with a unique source and such that the source and 
all sinks lie in the outer face. Additionally an arbitrary subset of the sinks of 
degree 1 are marked; these arc called the sailing sinks of O (small shaded squares 
in Figure [TJb)). Edges incident to sailing sinks are called sailing edges. 

As illustrated in Figure QJa)-(b), there is a bijection between the class I of 
involutive Baxter permutations and the class M of monosource orientations which 
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Figure 1. (a) An involutive Baxter permutation it (black points 
give the diagrammatic representation of it) superimposed with the 
associated embedded plane bipolar orientation O (a black point 
in each edge of O, a white vertex for each vertex of O). The 
whole drawing is invariant by the reflexion according to the line 
{x = y}. (b) The monosourcc orientation M obtained by keeping 
the part of O below the line {x = y}, where sailing sinks are 
represented as small shaded squares, (c) the associated decorated 
plane bipolar orientation obtained by merging all the sinks of M. 
The marked sink-edges (which are drawn bolder) are those incident 
to sailing sinks in M, the marked sink-corners (indicated by the 
small triangles) are the newly created sink-corners. 



transforms standard parameters as follows (a descent in a permutation tt S & n is 
an integer i G [l..n — 1] such that > 7r(i + 1), and a descent is said to cross the 
diagonal if ir(i) > i and ir(i + 1) < i + 1): 

2n non-fixed points <-> n non-sailing edges, 

2k descents not crossing the diagonal -H* k non-extremal vertices, 

p fixed points <-> p sailing sinks, 

r descents crossing the diagonal <R- r non-sailing sinks. 

We now claim that orientations in Ai correspond to plane bipolar orientations 
with certain decorations. Given a plane bipolar orientation, the sink-degree is the 
degree of the sink, and a sink-edge is an edge incident to the sink. A corner of 
a planar map is an angular sector delimited by two consecutive edges around a 
vertex. For a plane bipolar orientation, a sink-corner is a corner incident to the 
sink but not in the outer face (note that the number of sink-corners is the sink- 
degree minus 1). Define a decorated plane bipolar orientation as a plane bipolar 
orientation where an arbitrary subset of the sink-corners are marked, and a subset 
of sink-edges are marked in such a way that the sink-corners incident to a marked 
sink-edge are marked. As shown in Figure HJb)-(c), there is a bijection between 
the class M. of monosource orientations and the class T> of decorated plane bipolar 
orientations with the following parameter-correspondence: 

n non-sailing edges f-> n non-marked edges, 

k non-extremal vertices <-> k non-pole vertices, 

p sailing sinks <H- p marked sink-edges, 

r non-sailing sinks <R- p + r — 1 marked sink-corners. 
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3. Encoding by paths 

Wc now explain how to encode the sink-edges and sink-corners of a decorated 
plane bipolar orientation O, this is illustrated in Figure [2] Let i + 1 be the sink- 
degree (so there are i sink-corners), p the number of marked sink-edges and q the 
number of marked sink-corners. By a binary walk we will mean an oriented walk 
in 1? having steps East (+1, 0) and North (0, +1). First, encode the marked sink- 
corners by a binary walk obtained by reading the sink-corners from left to right, 
writing an East-step if the sink-corner is marked and a North-step otherwise. Then 
append an East-step to both the beginning and end of the binary walk; we thus 
have a binary walk with q + 2 East-steps and i — q North-steps. Note that the 
sink-edges that are allowed to be marked correspond to points of the walk preceded 
and followed by an East-step (the ones corresponding to marked sink-edges are 
surrounded in Figure Delete these vertices, and then renormalize the path to 
have only steps of length 1. Above each East-step of the rcnormalizcd path write 
the number of points that have been deleted in the corresponding horizontal portion 
(before renormalization) ; finally delete the last (East-) step of the walk. The finally 
obtained walk W starts with an East-step if not empty (it is empty iff all sink-edges 
are marked); it has length i + 1 — p, i — q North-steps, q + 1 — p East-steps, and 
is accompanied by a sequence S of q + 2 — p nonnegative numbers adding up to p. 
The pair (W, S) is called the sink-code for O. 



r 



(0, 0, 1, 1) 



Figure 2. Encoding the marked sink-corners (indicated as small 
triangles) and sink-edges (indicated as bolder edges) by a binary 
walk and a sequence of weights. 

Let T be the class of non- intersecting triples W\, W2, W3 of finite binary walks 
having starting points (—1, 1), (0, 0) and (0,-1), same numbers of North-steps, and 
with length(Wi) = length(W2) = length(VT3) — 1. As described in [3] (the original 
bijection, between Baxter permutations and triples of paths, is due to Dulucq and 
Guibert [TT]) there is a bijection between the class O of plane bipolar orientations 
and the class T, with following parameter-correspondence (see also Figure [3ja)): 
n edges <-> length (Wi) = n — 1, 
k non-pole vertices f-> W\ has k East-steps, 

i + 1 sink-edges <H> W3 ends with an East-step followed by i North-steps. 
Now define £ as the class of 4-tuples (Wi, W2, W3, S), where (Wi, W2, W3) is a 
non-intersecting triple of binary walks starting respectively from the points (— 1, 1), 
(0, 0) and (0, —1); and S is a sequence of non-negative integers such that: 

• The walks Wi and W2 have same lengths and same numbers of East-steps. 

• Denoting by (£2,2/2) and (£3,2/3) the coordinates of the respective end- 
points of Wi and W3, we have X3 > X2 and X2 + 1J2 > £3 + J/3- Let 
a := X3 - x 2 and b := x 2 + 2/2 - x 3 - y 3 . 

• The sequence S is made of a + 1 non-negative integers that add up to b. 
Let O be a decorated plane bipolar orientation with sink-degree i + 1. Let 

(Wi,W2,W3) € T be the triple of walks associated with O (without the dec- 
orations), and (W,S) the sink-code for O. Define W3 as W3 where the suf- 
fix East North 1 is replaced by W, see Figure [31 Then it is easily checked that 
E := (Wi,W 2 , W3, S) <G £. Note that one can recover W3 from E (W 3 is the unique 
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Figure 3. (a) A plane bipolar orientation is encoded by a non- 
intersecting triple of binary walks, (b) The encoding of a decorated 
plane bipolar orientation. 

binary walk ending at (x2 + 1, J/2 — 1) and equal to W% in the area {x < £2}), 
hence one can recover O. Moreover if O has p marked sink-edges and q marked 
sink-corners, then with the notations above, b = p and a = q + 1 — p. 

Overall, we obtain a bijection between the class T> of decorated plane bipolar 
orientations and the class £ , with the following parameter-correspondence: 
m edges <H> Wi and W2 have length m — 1, 
k non-pole vertices <H> W\ and W2 have k East-steps, 
p marked sink-edges -f-> W3 has length m — p, 
q marked sink-corners <H> W3 has k + q — p + 1 East-steps. 
Composing the bijection between I and T> with the bijection between T> and £ 
we finally obtain (taking m = n+p and q = p + r — 1 in the correspondence above): 

Theorem 1. There is a bijection between involutive Baxter permutations with 2n 
non-fixed points, 2k descents not crossing the diagonal, p fixed points, r descents 
crossing the diagonal; and 4-tuples of the form (Wi, W2, W3, S) where (W\, W2, W3) 
is a non-intersecting triple of binary walks with starting points (—1,1), (0,0), 
(0, —1), end-points (k — 1, n + p — k), (k, n + p — k — 1), (fc + r, ?i — fc — r— 1), and 
where S is a sequence of r + 1 nonnegative numbers adding up to p. 



4. Counting 

Let (Ai,A2,As) and (B±, B2, -B3) be the starting points and end-points in 
Theorem [TJ By the Lindstrom-Gessel-Viennot lemma [T3], the number of non- 
intersecting triples of binary walks with starting points Ax, A2, A3 and end-points 
B\,B2,B^ is the determinant of the 3x3 matrix (rriij), with rriij the number 
of binary walks from A4 to Bj (note that each entry m-ij is an explicit binomial 
coefficient). The number of choices for the sequence 5 in Theorem [T] is clearly equal 
t° ( P ^ r ) • We obtain (taking out of the determinant a common binomial factor for 
each column): 

Theorem 2 (multivariate enumeration formula). For n > 0, and k, p, r non- 
negative integers, the number a„_k.p.r of involutive Baxter permutations with 2n 
non-fixed points, 2k descents not crossing the diagonal, p fixed points, r descents 
crossing the diagonal is given by 

q(q + l) g(g-l) s(s-l) 
fc(g+l) (k+l)q s(t+l) (1) 
fc(fe-l) k{k + l) t(i+l) 



Q>n : k : p,r 



p + r\ I n + p — 1\ In 



nq 2 (q + l)(k + l)(t+l) 



where q := n + p — k, s := n — k — r , t := k + r . 
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An equivalent multivariate formula for a n< k,o,r has been obtained by Bousquet- 
Melou [5] using the "obstinate" kernel method. Note that, by the correspondence 
of Section [2 the number a n ,k,o,r counts monosource orientations (without taking 
sailing sinks into account) with n edges, r sinks, and k non-extremal vertices. 

We now prove that the number b n of involutivc Baxter permutations with no fixed 
point and 2n elements satisfies b n = ( „^ 1 2 ) " (n+2) ( 2 ™) (even though b n = J^k.r a n,k,o,r, 
our proof does not exploit the multivariate formula of Theorem [5]). Let T n be the 
set of involutivc Baxter permutations of size 2n with no fixed point. In this part it is 
convenient to rotate the encoding triples of paths by 45 degrees counter-clockwise, 
to delete the first (East-) step in the third path of the triple, and to rescale by 
\/2. This way, the binary walks considered in the previous section become paths 
having steps (-1/2, +1/2) (annotated \) or (+1/2, +1/2) (annotated f) Q, and 
the bijection of Theorem [1] specializes as follows: 

Claim 3. For n > 1, T n is in bijection with the set lZ n of non-intersecting triples 
of paths, each with n — 1 steps either \ or with starting points (—1,0), (0,0), 
(1, 0) and such that the endpoints of the first two paths are at distance 1 on the line 

{y = ^}- 

Proof. By Theorem [T] J- n is in bijection with the set of non-intersecting triples of 
finite binary walks (Wi,!^,^) with starting points (—1,1), (0,0), and (0,-1), 
and end-points on the line {x + y = n — 1} such that the end-points of W± and Wi 
are at distance a/2- Since the 3 walks do not intersect, the first step of the third 
walk is always an East-step, hence can be removed with no loss of information. 
This way the 3 walks start on the line {x + y = 0} with W\ at distance a/2 from 
W2 itself at distance a/2 from W3 . Hence, rotating the figure counter-clockwise by 
7r/4 and rescaling by \/2, one has a triple of paths in lZ n . B 

To enumerate the triples in lZ n , we inject 7Z n in the bigger set U n defined the 
same way, except that the third path is allowed to intersect the two other paths. 
Let S n be the subset of objects in lA n where the third path meets the second path 
(and possibly also the first path); so we have U n = lZ n + S n . Let u n , r„, s n be the 
cardinalities oiU n , 1Z„, and S n , respectively. We have u n = r n + s n , so that 

bn $n- 

We now state a basic lemma [T5] which we will use to obtain formulas for u n and 
s n (the case k = 1, which gives the Catalan numbers, is illustrated in Figure Eta)): 

Lemma 4 (folklore). For n and k positive integers, let be the number of non- 
intersecting pairs (P\,P2) of paths (counted up to horizontal translation) each with 
n — 1 steps either \ or starting at distance k on the line {y = 0} and ending 
at distance 1 on the line {y = (n — l)/2}. Then 

{k) _ 2fc(2ra- 1)! 
a " ~ (n-*)!(n + fc)!' 

The lemma directly yields a formula for u n ; indeed the first two paths of a triple 
in U n are non-intersecting, start at distance 1 on {y = 0} and end at distance 1 on 
{y = ^y^}, an d the third path is unconstrained. Hence 



2"~ V, 1 ) = 2 n - 



(2n)! 



n!(n + l)!' 

To obtain a formula for s n , we "double" the set S n . For a triple 7 € <S„, the mirror 
of 7 is obtained by applying a vertical mirror (reflexion according to a vertical line, 



■*"We talk about walks when steps arc {East, North} and paths when steps are 
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(a) (b) 

Figure 4 . (a) A non-intersecting pair of paths with starting points 
and end-points at distance 1 can be encoded by a Dyck word, (b) 
bijection between V„ and S n + mir(<S„). 



up to a global translation) to 7. Denote by mir(5„) the set of mirrors of triples in S. 
Note that <S n nmir(«S n ) is empty (indeed, in S n , the middle-starting path intersects 
only the right-starting path; whereas in mir(<5>„) the middle-starting path intersects 
only the left-starting path). We now establish a bijection between S n + mir(«S„) 
and a set easy to count. Let V n be the set of triples of paths, each with n — 1 
steps either \ or /*, with starting points (—1,0), (0,0), (1,0), and such that the 
left-starting path and the right-starting path do not intersect and end at distance 
1 on the line {y = 

Claim 5. The set V n is in bijection with S„ + mir(<S„). 

Proof. The bijection relies on a simple argument akin to the Gessel-Viennot lemma. 
First we describe the mapping from V n to S n + mir(«S n ). Consider a triple of paths 
from V n , and denote by Pi, P m , P r the paths starting from (—1, 0), (0, 0), and (1, 0), 
respectively. Since the end-points of Pi and P r are at distance 1 (i.e., consecutive) 
on {y = 2-=-!-}, the path P m has to intersect Pg U P r . Let v be the first intersection 
of P m with Pg U P r (note that v can not be on both Pg and on P r , see Figure Bib)). 
If v £ P r we exchange the parts of P r and P m after v, this yields a triple of paths in 
S (see Figure0Jb)); if v <G Pg we exchange the parts of Pg and P m after v, this yields 
a triple of paths in mir(iS). It is now straightforward to get the inverse mapping, 
from S n + mir(5 n ) to V„. Let 7 € S n + mir(iS„), and denote again by Pg, P m , and 
P r the paths starting from (—1,0), (0,0), and (1,0), respectively. If 7 £ S let v be 
the first intersection of P m and P r ; exchange the portions of P m and P r after v. If 
7 £ mir(iS) let v be the first intersection of Pg and P m ; exchange the portions of Pg 
and P m after v. B 

Let v n be the cardinality of V„. Claim [5] implies that v n = 2s n . Now v n is 
easy to obtain. Indeed, for a triple in V n , the left-starting path and right-starting 
path start at distance 2 on {y = 0}, end at distance 1 on {y = and are 

non-intersecting; and the middle-starting path is unconstrained. Hence, with the 
notation of Lemma 0] 

v - g»-i, 7 (2) _ 2 »+i (2n-l)! 
" " (n-2)\(n + 2)V 

so that s„ = v n /2 = 2 n ^ n _2)\(n+2)\ ■ From b n = u„ — s n and the expressions of u n 
and s n wc obtain: 
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Theorem 6 (univariate formula, recovers [5] in a bijective way). The number b n 
of involutive Baxter permutations with no fixed point and 2n elements is 

tn ~ ( n + l)( n + 2)UJ' ( ) 

Note that, by the correspondence of Section [51 b n is the number of monosource 
orientations (without taking sailing sinks into account) with n edges. 
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Mireille for communicating to me the counting formulas for involutive Baxter per- 
mutations. 
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